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SUMMARY 

A  review  is  presented  of  the  principles  of  computer  synthesis  of  external  world  visuals 
for  raster  displays.  The  areas  of  environment  description ,  edge  and  polygon  clipping , 
hidden  surface  removal ,  shading  and  image  aberrations  are  discussed.  Particular  attention 
is  given  to  hierarchical  environment  structure,  image  coherence,  shading  functions  and 
area-averaging  edge  smoothing  techniques. 
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NOTATION 


R3  Euclidean  3-space 

a,  b,  .  .  .  denote  points  in  R3 

Ojc,  av,  ac  co-ordinates  of  the  point  a  in  R' 
a,  b,  .  .  .  denote  vectors  from  the  origin  to  a,  b,  .  .  .  in  R3 

ab  is  the  directed  line  segment  from  a  to  b 

n  is  the  outward  normal  direction  to  a  plane 

a  b  dot  product  between  a  and  b 

axb  cross  product  between  a  and  b 

aT  transpose  of  the  vector  a 

'!(■)  Euclidean  norm 

■  |  absolute  value 

OXYZ  environment  frame  of  reference 

O'X'  Y'Z'  observer  frame  of  reference 

o',  b', .  .  .  denotes  vectors  in  O'X'  Y'Z' 
ri  is  the  outward  normal  direction  in  O' X'  Y'Z' 

O.iX.sYs  view  plane  co-ordinate  system 

77  view  plane 

0i,  0*.  03  Euler  angles 

T  transformation  matrix 

(/,  /)-th  clement  of  T 
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I.  INTRODUCTION 


The  use  of  manned  flight  simulators  in  military  aviation  is  now  welt  established  in  the  USA, 
UK  and  other  NATO  countries.  Currently  consideration  is  being  given  to  the  establishment  of 
a  DSTO  research  simulation  facility  to  complement  Service  training  simulators  and  detailed 
mathematical  modelling  studies.  As  part  of  this  work  investigations  are  being  made  into  key 
simulation  methodologies  and  this  paper  deals  with  the  synthesis  of  the  external  visual 
environment. 

The  main  approaches  to  flight  simulation  visuals  are: 

(i)  Shadow  graph.  This  comprises  a  transparency  illuminated  by  a  point  light  source  to 
give  an  image  on  a  curved  screen.  The  field  of  view  can  be  quite  large,  resolution  is  normally 
good  whilst  changes  in  orientation  are  simulated  faithfully.  However  the  range  of  light  and 
terrain  simulated  is  restricted  by  the  limited  visual  content  and  total  possible  movement  of  the 
transparency  with  respect  to  the  light  source.  Hence  the  method  has  most  utility  in  rendering 
earth 'sky  backgrounds  in  combat  simulation. 

fii)  Anamorphic  Motion  Picture.  A  cine  film  is  made  along  a  specified  flight  path  over  the 
area  of  interest,  and  is  viewed  by  projection  with  optical  correction  used  to  simulate  motion 
with  respect  to  the  flight  path.  The  approach  has  some  desirable  features:  cine  film  resolution 
is  good,  w  ide  field  of  view  is  possible  and  three-dimensional  objects  appear  in  correct  perspective. 
The  method  of  simulating  movement  of  the  viewpoint  away  from  the  viewpoint  of  the  camera 
originally  used  to  make  the  film  consists  of  distorting  the  image  by  use  of  variable  anamorphic 
lenses  which  produce  magnification  that  is  controllable  in  magnitude  and  direction  across  the 
field  of  view.  While  this  method  gives  good  results  for  objects  in  the  ground  plane,  objects 
standing  up  above  the  ground  are  compressed  expanded  and  lean  to  the  left  or  right,-6  particularly 
for  large  excursions  from  the  desired  flight  path.  The  latter  phenomenon,  together  with  the 
limited  range  of  visual  environments  possible,  restrict  the  applicability  of  the  approach  to  take-off 
and  landing  simulation. 

(iii)  Scanned  Physical  Model.  In  this  method,  a  contoured  physical  model  is  scanned  by  a 
television  camera  with  subsequent  reproduction  on  an  appropriate  display  device.  Careful 
modelling  and  high  level  of  detail  ensure  excellent  rendition  of  cultural  features.  Perspective 
changes  are  achieved  by  vertical  and  lateral  motion  of  the  television  camera. 

A  modified  version  of  this  approach  has  been  proposed  in  Reference  26.  Instead  of  a 
television  camera,  the  model  is  scanned,  in  television  raster  format,  by  a  laser  beam.  Arrays  of 
photomultipliers  collect  the  reflected  light  and  modulate  a  scanned  laser  projector.  Perspective 
and  motion  arc  synthesized  by  the  position  of  the  exit  pupil  of  the  laser  and  the  orientation  of 
the  raster. 

There  arc  two  major  limitations  of  scale  model  based  visuals.  First,  the  relatively  large 
amount  of  detail  present  in  the  model  precludes  frequent  changes  in  the  environment  definition, 
and  second,  the  restricted  geographical  area  represented,  together  with  opto-mechanical  limi¬ 
tations.  restricts  the  range  of  simulated  manoeuvres.  Nevertheless,  both  civilian  and  military 
pilot  training  have  successfully  employed  scale  models  for  limited  terrain  simulations  such  as 
take-off  and  landing 

(iv)  Raster  based  Computer  Generated  Imagery  (CGI  I.  In  this  approach  images  arc  generated 
by  computation  based  on  numerically  stored  environment  data  representing  polyhedral  models 
of  environment  objects  in  a  Cartesian  co-ordinate  system.  The  scene  generation  process  consists 
of  two  phases:  the  first  involves  mapping  of  the  three-dimensional  environment  onto  a  two- 
dimensional  view  plane,  at  the  same  time  eliminating  out  of  view  objects  from  further  processing. 
The  second  phase  involves  the  solution  of  the  hidden  surface  problem,  i.e.  determining  which 
object  surface  is  visible  at  each  picture  element. 
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The  CGI  approach  to  synthesis  of  visuals  is  particularly  suited  to  research  orientated  I 

simulation.  In  comparison  to  scale  models  it  offers  increased  versatility:  there  are  no  serious  1 

limitations  to  the  geographical  area  modelled,  the  inclusion  or  exclusion  of  specific  visual  cues,  j 

nor  the  range  of  manoeuvres  possible.  Although  the  rendering  of  fine  detail  is  at  present  limited  \ 

in  CGI.  current  trends  in  digital  processing  point  toward  rapidly  improving  capability. 

This  report  reviews,  at  the  conceptual  level,  the  present  methodology  for  raster  CGI  and 
delineates  the  significant  aspects.  Geometrical  considerations  pertaining  to  environment  modelling 
and  transformations  are  discussed  in  Sections  2  and  3  whilst  clipping,  the  technique  of  disting¬ 
uishing  between  in-view  and  out-of-view  objects  is  considered  in  Section  4.  In  Section  5  a  number 
of  hidden  surface  algorithms  are  examined  with  particular  reference  to  sorting  and  image 
coherence  utilization.  Image  realism,  which  here  will  be  taken  to  mean  those  characteristics  of 
an  image  whose  presence  or  absence  attenuates  realism,  is  considered  in  Section  6.  Since  this 
area  is  most  prone  to  subjective  judgment,  attention  is  restricted  to  the  areas  of  shading 
and  raster  quantization  effects.  In  particular,  methods  are  discussed  foi  the  synthesis  of  distance 
and  horizon  fading,  smoothing  of  curved  surfaces  approximated  by  polygons  and  area  averaged 
edge  smoothing  techniques. 

Details  pertaining  to  system  specific  aspects  of  CGI,  such  as  computer  and  display  hardware 
will  be  treated  in  a  subsequent  report. 

2.  GEOMETRICAL  CONSIDERATIONS 

2.1  The  Environment 

The  visual  environment  for  flight  simulation  comprises  three  classes  of  objects: 

I  a  planar  surface  representing  a  local  "flat  earth”,  objects  on  the  earth’s  surface 
including  terrain,  and  objects  above  the  earth  such  as  aircraft  and  clouds; 

II  a  diffuse  atmosphere  with  the  property  that  the  surface  colours  of  objects  appear  to 
desaturate  at  a  large  distance  from  the  observer; 

111  the  sky,  which  is  the  upper  part  of  the  atmosphere  (and  beyond)  as  seen  from  the 
surface  of  the  earth. 

The  modelling  of  objects  of  class  I  will  now  be  considered  whikt  the  representation  of  classes  II 
and  III  is  deferred  to  Section  6. 

It  will  be  assumed  that  there  exists  a  Cartesian  co-ordinate  system,  with  origin  located 
within  the  region  of  interest  such  that  each  object  of  class  1  can  be  located  and  described  in  this 
co-ordinate  system,  with  objects  (including  the  terrain)  being  modelled  as  convex  polyhedra. 

Henceforth  when  reference  is  made  to  an  object  it  is  to  be  assumed  that  the  polyhedral  model 
of  the  object  is  referred.  Although  the  assumption  of  polyhedral  models  may  seem  unduly 
restrictive,  it  does  result  in  clipping  and  hidden  surface  algorithms  involving  only  linear 
equations.  Moreover  it  will  be  shown  in  Section  6  that  the  smooth  appearance  of  a  curved 
object,  modelled  as  a  polyhedron,  can  be  restored  by  shading. 

Thus  each  object  can  be  described,  in  the  aforementioned  co-ordinate  system,  by  the  location 
of  its  vertices  and  the  relationship  between  the  vertices  and  the  faces  of  the  object. 

In  addition  to  defining  single  objects,  it  is  sometimes  advantageous  to  classify  the  environ¬ 
ment  into  clusters.  A  duster  is  a  collection  of  objects  (or  faces  of  an  object)  which  can  be  treated 
as  a  single  entity  with  respect  to  a  particular  property.  For  example,  a  cluster  may  consist  of  all 
the  faces  belonging  to  a  single  object,  or  it  may  be  defined  by  regional  extent.  Further,  two 
clusters  are  said  to  be  linearly  separable  if  a  plane  separates  them.  An  alternative  descriptor  is  a 
quadratically  separable  cluster;  that  is.  one  which  can  be  completely  enclosed  by  a  sphere.  It  will 
be  shown  that  the  centre  and  radius  of  such  a  sphere  are  useful  parameters  for  a  particular  form 
of  clipping. 

2.2  Viewing  Geometry 

In  this  section  some  useful  geometric  relationships  are  reviewed  and  the  geometry  of  viewing 
a  polyhedral  object  in  a  scene  is  defined. 

Let  a,  b,  c  be  three  points  defining  a  plane  in  R 3.  Then  the  outward  normal  direction  is 
given  by: 
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n  —  ac  k  be 


i  j  k 

t'jT  Q X  i'{/'  Uy  C* ~Qz 

Cj  bx  Cy  by  cz-bz 


If  a  is  a  point  on  a  plane  with  outward  normal  n,  then  the  equation  of  the  plane  is 


n  {. v  a)  —  0;  xT  =  (\\  y,  z) 

Let  ti(xi,  Vi,  -'<),  i  =  1,....  n  be  the  »  vertices  of  a  polygon.  Then  the  centroid  of  the 
polygon  is 


M 
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The  geometry  of  viewing  an  object  in  a  scene  is  illustrated  in  Fig.  2.1. 

The  frame  OXYZ  represents  the  environment  co-ordinate  system  whilst  OXYZ’  is  the 
frame  attached  to  the  observer.  The  location  of  the  vertices  of  an  object  and  the  origin  of  the 
observer  frame  are  specified  in  environment  co-ordinates.  The  viewing  plane.  IT  is  parallel  to  the 
O' X'  V"  plane  and  the  view  frame  OsX s  Y.<  is  in  the  usual  sense  as  viewed  by  the  observer. 


2.3  Data  Base  Preparation 

It  is  clear  from  the  preceding  remarks  that  the  data  required  Vo  numerically  describe  an 
object,  in  the  sense  of  spatial  extent,  are  the  co-ordinates  of  the  object's  vertices.  However,  in  a 
number  of  image  synthesis  algorithms  (e.g.  clipping  and  hidden  surface)  the  quantities  of  interest 
are  not  vertices  per  se  but  edges  and  polygons.  This  implies  that  the  vertices  defining  the  environ¬ 
ment  have  to  be  indexed  and  stored  in  an  order  compatible  with  the  algorithms  such  that  edges 
and  faces  can  be  readily  determined. 

There  are  a  number  of  ways  one  may  index  and  store  the  vertex  data  and  it  is  instructive 
to  consider  the  following  two  approaches. 


/.  Fixed  Sequence  Mon-repeated  lerticex 

In  this  method  the  vertices  are  indexed  and  stored  in  a  fixed  sequence  corresponding  to  an 
a  priori  defined  set  of  relationships  between  vertices,  edges  and  laces.  As  an  example  consider 
the  oblong  of  Fig.  2.2  and  let  the  following  table  define  the  relationship  between  vertices  and 
faces  stored  in  the  computer.  (Note  that  the  sequence  of  vertices  in  the  middle  column  is  in  the 
“right  hand  screw  sense"  with  respect  to  outward  surface  normal.) 


Face  No. 

Vertices 

Adjacent  Faces 

A 

1 1  I'-.'  i  a  n 

h  /  .  A  /.i 

A 

n  n  /  ns 

1 1  A  A  A 

./:> 

rti  r.,  t\ 

A  A  A  A 

A 

V:  f‘7  Vh 

t\  h  A  A 

A 

t'a  ia  c.-,  t'n 

t\  A  A  A 

A 

n  i :  r  t  (•« 

A  AAA 

Note  that  the  indexing  of  the  figure  in  Fig.  2.2  corresponds  to  the  above  rules  of  association 
between  vertices  and  faces.  If  however  the  object  is  wrongly  indexed  the  resulting  synthesized 
image  will  have  little  resemblance  to  the  true  object.  In  addition,  it  is  evident  that  there  must 
be  a  set  of  association  rules,  similar  to  the  above,  for  each  class  of  polvhcdra  (such  as  tetrahedrons, 
pyramids  and  octagons). 

Although  the  present  approach  is  cumbersome  and  requires  careful  indexing  of  environ¬ 
ment  vertices  it  requires  minimal  memory  since  each  vertex  is  only  entered  once;  this  implies 
that  the  approach  is  efficient  with  respect  to  those  algorithms  that  involve  processing  each  vertex 
independently.  This  is  in  contrast  to  the  method  discussed  next. 
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FIG.  2.2 


//.  Polygon  Based  Vertex  Sequence 

In  this  approach  objects  in  the  scene  are  partitioned  into  faces  (which  by  assumption  are 
polygonal),  the  vertices  of  each  polygon  are  indexed  in  the  right  hand  screw  sense  corresponding 
to  the  outward  surface  normal.  The  implication  is,  as  far  as  numerical  data  description  is 
concerned,  that  object  faces  rather  than  objects  are  to  be  treated  as  the  quantities  of  interest. 
Thus  for  the  oblong  of  Fig.  2.2  the  following  two  vertex  sequences  are  admissible: 

t'6  n  t’.l  t'5  n  ('■’  <3  ft  t'i  ft  fit  f 3  ft  f ft  f 5  f«  l'3  f 8  fj  f.|  l'l  f 6  ft  f> 

or 

ft  f  >  f 3  ft  f«  f|  ft  f 5  fj  ft  /'8  t‘3  ft  tfi  I'd  t'8  ft  f8  t’5  t'l  ft  t'fi  ft  t'3 

The  approach  proves  convenient  from  the  point  of  view  of  polygon  based  algorithms  although 
the  repetition  of  each  vertex  in  the  sequence  requires  increased  storage  capacity.  Moreover  this 
implies  that  the  approach  is  inefficient  with  respect  to  vertex  and  edge  based  algorithms  (such  as 
co-ordinate  transformations  and  clipping).  In  the  example  considered  above  each  vertex  appears 
three  times  whilst  each  edge  appears  twice. 

A  conceptually  more  appealing  approach  than  the  preceding  two  methods  is  to  represent 
the  environment  objects  not  in  terms  of  co-ordinates  of  vertices  but  in  terms  of  position  and 
dimension  of  “higher  level”  primitives  such  as  cubes,  oblongs,  tetrahedrons  and  so  on.  Then  each 
time  a  primitive  appeared  in  the  environment,  an  algorithm,  corresponding  to  the  primitive, 
would  be  invoked  to  generate  its  vertices,  edges  or  faces.  The  efficiency  of  the  approach  is  depen¬ 
dent  on  the  careful  characterization  of  objects  in  terms  of  the  primitives  in  order  to  minimize 
the  number  of  superfluous  edges  and  vertices  that  have  to  be  removed  from  the  resultant  image. 
For  example  consider  the  object  in  Fig.  2.3(a)  and  assume  it  is  to  be  represented  in  terms  of  the 
primitives  of  Fig.  2.3(b).  One  representation  (in  exploded  view)  is  shown  in  Fig.  2.3(c)  and  it  is 
clear  that  the  shaded  surfaces  are  redundant.  A  more  economic  representation  is  that  of  Fig.  2.3(d). 

An  extension  of  the  above  approach  is  to  have  primitives  that  are  actually  objects  such  as 
aircraft,  trees,  or  mountains,  and  use  them  as  the  basis  for  environment  representation.  The 
key  difficulty  here,  particularly  with  regard  to  objects  such  as  mountains,  is  the  numerical 
characterization  of  descriptive  qualities.  For  example,  if  a  mountain  is  to  be  represented  it  is 
desirable  that  in  addition  to  geographical  position  and  extent,  attributes  such  as  "ruggedness" 
be  also  numerically  characterized.  Methodology  to  handle  this  problem  has  yet  to  be  forthcoming. 
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FIG.  2.3 

3.  TRANSFORMATIONS 

For  a  scene,  described  in  environment  co-ordinate  system  OXYZ ,  many  images  can  be 
generated  depending  on  the  position  from  which  the  scene  is  viewed.  To  generate  a  specific 
image — namely  the  image  of  the  scene  as  viewed  by  the  observer,  the  objects  comprising  the 
scene  have  to  be  described  in  terms  of  the  co-ordinate  system  OsXs  Ys.  The  machinery  necessary 
to  achieve  this  is  now  developed. 

3.1  Translation  and  Rotation 

Let  the  position  of  O'  in  OXYZ ,  be  specified  by  the  triple  ( Ox',Oy\Oi )  and  let  the 
orientation  of  O  X'  Y'Z  with  respect  to  OXYZ  be  specified  by  the  angles  (fi.  0-i  and  fi3  (Fig.  3.1). 
Oi  is  the  angle  of  rotation  about  O  Y  axis: 

0-z  is  the  angle  of  rotation  about  OX  axis; 

03  is  the  angle  of  rotation  about  OZ  axis. 
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Then  any  point  P{x,y,  c)  in  the  frame  OXYZ  has  co-ordinates  (x',y,  z')  in  the  observer  frame 
O' X'  Y'Z'  such  that4 


cos  0 3  sin  0 3  0\ 


0 


0 


sin  0 3  cos  lh  OllO  cos  sin  0> 


0 


0 


'cos  0\ 

0 

-  sin  0|\ 

,X-°x\ 

0 

1 

0 

\y-Oy'  I  (3.1.1.) 

,sin  0 1 

0 

cos  0\  } 

\z-Oi'J 

Note  that  since  translation  and  rotation  are  non-commutative  operations,  the  above  expression 
represents  the  following  sequence: 

(a)  translation; 

(b)  rotation  about  OY  axis; 

(c)  rotation  about  OX  axis; 

(d)  totation  about  OZ  axis. 

Relationship  (3.1.1.)  is  more  conveniently  expressed  in  matrix  form  if  each  point  (.v,  y,  z) 
is  represented  in  homogeneous  co-ordinates5  by  the  4-tuple  (.v, y,  z,  1).  That  is; 


where 


/ 


\ 


sin  O3  sin  0>  sin  Pi  F 

sin  03  cos  02 

sin  03  cos  0i  sin  9>  — 

*14 

-r  cos  O3  cos  0i 

-  cos  03  sin  0i 

cos  O3  sin  P->  sin  0 1  — 

cos  03  COS  02 

cos  03  cos  0i  sin  0->  4- 

*24 

—  cos  0i  sin  03 

4  sin  03  sin  0i 

sin  0i  cos  0> 

—  sin  02 

COS  02  COS  0i 

*34 

0 

0 

0 

1 

(3.1.2) 


/h  =  -  Oj'[cos  O3  cos  0i  4  sin  O3  sin  0->  sin  0 1]  —  OJ  sin  O3  cos  02  — 
-  04[sin  O3  cos  Pi  sin  O3  —  cos  O3  sin  Pi] 


f>  1  =  Ox '[cos  Pi  sin  0  3  -  cos  03  sin  0->  sin  0i]  —  Oy'  cos  O3  cos  63  — 
—  Oz'[sin  O3  sin  0i  4-  cos  O3  cos  Oi  sin  fr>] 


I3 1  =  -  Ox  sin  Pi  cos  Pj  -i  Oy  sin  fl->  ■  -  Oi  cos  O3  cos  Pi . 


Such  an  apparent  33  increase  in  dimension  in  the  representation  of  a  point  leads  to  two 
ameliorating  circumstances.  Firstly  an  arbitrary  scale  factor  can  be  introduced  that  allows  the 
use  of  fixed  point  arithmetic,  which  is  particularly  effective  in  matrix  arithmetic  routines. 
Secondly,  the  projective  geometry  of  homogeneous  co-ordinates  allows  for  the  concatenation 
of  transformations. 


3.2  Perspective  Transformation 

The  planar  projection  that  represents  real  objects,  as  viewed  by  the  naked  eye  through  a 
homogeneous  medium  is  perspective.  The  essential  features  of  the  perspective  transformation  are: 
(i)  The  .v,  and  r*  co-ordinates  of  the  perspective  view  are  obtained  by  dividing  the  x' 
and  r'  observer  co-ordinates  by  the  distance  from  the  observer  forward  to  the  object,  z'. 
(ii)  The  “perspective  depth",  which  preserves  the  straightness  of  lines,  flatness  of  planes  and 
the  depth  ordering,  must  also  be  computed. 

For  the  geometry  depicted  in  Fig.  3.2  the  perspective  transformation  expressed  in  the 
observer  co-ordinate  system  is:1 

v,  =  x'(d/z') 

y*  =  v'(f//:')  (3.2.1.) 

=  (c'  d)(d!z') 

where  d  is  the  distance  of  the  viewing  plane  from  the  observer.  Although  the  perspective  trans¬ 
formation  does  not  preserve  z'  depth,  it  does  preserve  depth  relationships. 
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FIG.  3.2 

4.  CLIPPING 

The  process  of  clipping  involves  the  sorting  of  all  elements  of  a  scene  such  that  vertices  and 
edges  that  are:  (i)  behind  the  viewing  plane,  anil  (ii)  do  not  project  within  the  boundaries  of  the 
display  screen,  are  eliminated  whilst  edges  that  only  partially  project  onto  the  display  screen 
are  truncated  at  the  boundaries.  Although  this  procedure  is  relatively  simple  to  implement,  the 
computational  load  for  an  environment  of  high  complexity  becomes  inordinate  for  real  time 
image  generation. 


4.1  Cluster  Clipping 

One  way  to  speed  up  the  clipping  process  is  to  characterize  the  environment  in  a  structural 
form  —  typically  clusters.  Recall  that  a  cluster  is  any  object  (or  collection  of  objects!  enclosed  in 
a  bounding  volume.  Then,  as  a  first  step  in  clipping,  those  clusters  whose  bounding  volumes 
produce  images  outside  the  display  screen  can  be  eliminated  from  further  processing  whilst 
those  clusters  whose  images  are  within  the  display  screen  can  by-pass  the  subsequent  stages  of 
clipping. 

To  illustrate  cluster  clipping,  consider  a  cluster  whose  bounding  volume  is  a  sphere  with 
centre  at  (<>.  cu,  o)  and  radius  r.  Applying  the  transformation  of  Section  3  to  this  sphere,  it 
can  be  readily  shown  that  in  the  O'X'Y'Z'  frame  the  surface  is  again  a  sphere,  with  centre 
(<V,  Cy-  <':■)  and  radius  where: 


The  projection  of  this  sphere  onto  the  ff  plane  is  an  ellipse.  Projecting  this  ellipse  onto  the 
X'O'Z,'  and  Y'O'Z'  planes,  a  bounding  rectangle  for  the  image  of  a  cluster  is  defined  as  follows: 
With  reference  to  Fig.  4.l(«).  the  length  of  the  projection  in  the  X'O'Z'  plane  is 

Ijc  v  =  b"  -  a" 

where 

«"  =  r/tan(xi  x-Y) 
h"  =  cl  tan  (*i  i  *e) 

and  *i  =  tan  1  (o/c-) 


r  -  =  tan  1  [r/(o-- 
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Similarly,  with  reference  to  Fig.  4.l(/>),  the  length  of  the  projection  in  the  Y  O  Z  plane  is: 

/*•*•  =  f  tm 

where 

e"  =  d  tan  ( pt  p<) 

f"  =  d  tan  (pi  i  p-> ) 

and 

Pi  =  tan  1  (c„-lcf) 

Pi  =  tan  1  [riUy  -  t  o  '-  -  r2)*) 

The  rectangular  boundary  in  the  /7  plane  is  depicted  in  Fig.  4.2  where: 

y  =  dce-fci- 

&  =  dCy/Ci- 

and  the  following  cluster  clipping  rule  is  readily  deduced. 

Cluster  Clipping 

A  cluster  will  not  be  visible  if  any  of  the  following  statements  are  true: 

(i)  y  >  0  and  a"  >  b 

(ii)  y  >  0  and  b"  <  —b 

(iii)  S  >  0  and  e"  >  b 

(iv)  &  <  0  and  J"  <  -  b 

(v)  <v  +  r  <  d. 


•  (Y ,S)  J 


In  addition,  cluster  clipping  can  he  extended  to  eliminate  clusters  whose  projected  image  area 
is  smaller  than  the  resolution  limit  of  the  display  device 

It  i.  evident  that  if  the  environment  is  structured  such  that  each  cluster  is  made  up  of 
“smaller"  clusters,  then  the  recursive  application  of  the  cluster  clipping  algorithm  will  eliminate 
all  the  "out  of  view"  objects  from  subsequent  processing.  In  addition  cluster  clipping  can  be 
closely  related  to  the  concept  ol  "level  of  detail"-  1 11  selection  which  permits  the  selection,  for 
each  obieci  in  the  environment,  of  a  model  of  appropriate  complexity  consistant  with  the  regional 
extent  of  the  object,  its  relative  position  to  the  observer  and  the  resolution  of  the 
display.  Typically  the  ratio,  enclosing  sphere  radius  perspective  image  radius,  is  a  useful 
criterion  for  model  selection,  i.e.  if  the  ratio  is  large,  then  a  low  detail  model  will  be  adequate 
whilst  for  small  values  a  detailed  model  is  necessary.  I  he  transition  from  one  level  of  detail  to 
the  next  must  be  such  that  the  observer  does  not  perceive  the  change  from  one  model  to  another. 

The  level  of  detail  concept  is  important  in  eliminating  extraneous  visual  information  and 
associated  computational  effort.  The  number  of  models  associated  with  a  given  object  will  depend 
on  the  data  base  capacity  and  the  object  itself. 

4.2  Kdge  Clipping 

l  dge  clipping  is  the  procedure  that  reduces  a  polygon  surface  extending  beyond  some  three- 
dimensional  viewing  pyramid  to  a  surface  which  does  not  extend  beyond  the  pyramid  boundary. 
The  process  dips  off  those  parts  of  the  polygon  which  lie  outside  the  bounding  volume.  It  is 
assumed,  with  little  loss  of  generality,  that  the  display  screen  is  square:  the  associated  viewing 
pyramid  (henceforth  referred  to  as  "view box"!  is  depicted  in  f  ig.  4.3. 

Consider  now  a  transformed  edge  whose  vertices  lie  outside  the  view  box.  Clearly,  the  edge 
can  have  two  possible  relationships  with  respect  to  the  view  box: 

(i)  it  may  lie  completely  outside  the  view  box 
or 

( li  >  some  portion  of  it  lies  within  the  view  box.  In  this  ease  the  edge  must  intersect  two 
distinct  view  box  boundaries. 

In  order  to  determine  which  of  the  above  situations  is  applicable,  it  is  necessary  to  determine 
the  relative  position  of  the  edge  vertices  with  respect  to  the  view  box.  This  can  be  readily  accom¬ 
plished  by  performing  the  following  operations.''  " 


It: 

Then  reriex  (  v'.  r\  r')  is: 

I  b  i/ir'  V 

•  0 

outside  view  box  on  right 

> 

</>(/):'  •  \' 

•  0 

outside  view  box  on  left 

(A  </)-''  f' 

■  () 

above  view  box 

* 

{b  tl):'  .»•' 

0 

below  view  box 

•  <1 

on  wrong  side  of  display  screen 

It  is  evident  from  the  preceding  remarks  that  if  the  vertices  of  an  edge  satisfy  the  same 
conditions  then  that  edge  is  not  visible  and  can  be  eliminated  from  further  processing.  On  the 
other  hand  if  the  vertices  satisfy  two  different  conditions  then  it  is  possible  that  a  portion  of  the 
edge  is  visible.  To  determine  the  relevant  portion,  the  edge  has  to  be  truncated  at  the  appropriate 
view  box  boundaries.  The  formulae  to  achieve  this  follow  from  elementary  co-ordinate  geometry 
and  are  stated  below  for  an  edge  with  vertices  n(.\i,  n)  and  r-< (vj.  r_.)  in  the  X.sOsYs  plane. 

However  note  that  hither  plane  clipping  (see  Fig.  4.3)  has  to  be  performed  in  the  O' X'  Y'Z' 
frame  prior  to  perspective  transformation  since  the  final  division  destroys  one  bit  of  sign  infor¬ 
mation.  It  is  precisely  this  sign  information  that  distinguishes  points  in  front  from  those  behind 
the  display  screen.  Hence  an  edge  with  vertices  n(  vi  .  jV,  n').  rAx>' .  y  >' .  :-A)  will  intersect  the 
hither  plane 

in  ( v\  y. ;)  where 

v"  =  V|'  •  (v.‘  X\')Qh 

y  =  ,ti'  •  (yT  y\’)Qn 

:t  )Q„ 


and 


Qh=  , 

Zi  Cl 

Referring  to  Fig.  4.4  the  edge  n(vi,  yi),  i^va.rj)  will  intersect 

(i)  the  right  boundary  line,  x,  =  b 
in  ( x ,  y)  where 

V  =  -V  l  t  £>(.\2  .V|) 

.v  =  ,»'i  •  Q(y-  yi) 

where 

Q  =  Qit  =  [b  xi)!(xs  .vi) 

(ii)  the  left  boundary  line,  ,v«  =  h 
in  (.v,  y)  where 

Q  =  Qi.  =  (h  •  -vi)  f.v-.  vi) 

(iii)  the  top  boundary  line,  y,  =  b 

in  (x,  y)  where 

Q  =  Qr  =  (b  yi  )/(>•»  yi) 

(iv)  the  bottom  boundary  line,  y,-  =  -  h 
in  (x,  y)  where 

2  =  Qh  =  (h  -*  yxMiyt-yi). 


-C 

cn 


Top  line 


Bottom  line 


f 


Consider  an  edge,  with  vertices  17.  «••>.  which  is  not  wholly  within  the  viewbox  and  let 
i'm.  i'h.  i  /.,  it.  i'«  denote  the  intersection  of  the  edge  with  the  respective  boundary  plane/lines  as 
computed  by  the  preceding  formulae.  Then  the  pair  n.  17.  belonging  to  {it.  i;»,  17#,  it,  it,  it.  it}, 
such  that  n.  17  (1)  both  lie  on  the  segment  17  r>  and  (ii)  are  both  within  the  viewbox,  will  define 
the  clipped  edge  Otherwise  the  edge  in  question  is  out  of  view.  Repeated  application  of  this 
process  to  the  appropriate  edges  (as  determined  by  (4.2. 1 ))  will  cull  from  the  image  those  portions 
of  the  scene  that  extend  beyond  the  field  of  view  of  the  observer. 

4.3  Polygon  Clipping 

The  algorithm  of  Section  4.2  is  applicable  to  polygon  clipping  by  considering  each  edge  of 
the  polygon  and  clipping  it  against  the  viewbox.  Unfortunately  this  approach  involves  complicated 
reasoning  to  determine  where  to  add  edges  along  the  boundary.  This  is  evident  if  one  considers 
a  polygon  surrounding  a  viewbox  vertex  as  depicted  in  Fig.  4.5.  In  this  case  two  new  edges  have 
to  be  added  which  share  a  vertex  at  the  corner.  From  the  point  of  view  of  the  edge  clipping 
algorithm  it  is  a  tedious  process  to  compute  whether  or  not  a  polygon  surrounds  a  corner  of 
the  viewbox. 


FIG.  4.5  POLYGON  SURROUNDING  VIEWBOX  CORNER. 


A  clipping  algorithm  that  circumvents  this  difficulty  has  been  developed  by  Sutherland  and 
Hodgman.18  Basically  the  algorithm  assumes  that  polygons  are  represented  by  an  ordered 
sequence  of  vertices  without  repetition  of  first  and  last.  This  is  in  marked  contrast  to  the 
preceding  algorithm  which  regards  polygons  to  be  made  up  of  edges.  The  clipped  polygon  has 
identical  format,  with  new  vertices  introduced  in  sequence. 

To  illustrate  the  algorithm  consider  the  clipping  of  a  polygon  against  a  boundary  plane  as 
depicted  in  Fig.  4.6(a).  Clipping  is  accomplished  by  considering  pairs  of  vertices  (edges)  and 
retaining  only  those  vertices  that  are  on  the  visible  side  of  the  boundary  plane  together  with 
vertices  created  by  intersection.  The  resulting  polygon  is  shown  in  Fig.  4. 6(6).  Clipping  the  latter 
against  the  top  boundary  plane  results  in  the  final  clipped  polygon  of  Fig.  4.6(c).  For  a  complete 
description  of  the  algorithm  the  interested  reader  is  referred  to  Reference  18. 

In  terms  of  computational  effort  polygon  dipping  is  more  expensive.  The  reason  for  this  is 
twofold:  firstly,  each  pair  of  vertices  has  to  be  tested  against  each  boundary  plane  regardless  of 
whether  it  specifies  an  edge  which  is  entirely  within  the  viewbox.  and  secondly,  clipping  a  polygon 
against  a  boundary  plane  may  increase  the  number  of  vertices  describing  the  clipped  polygon 
and  hence  increase  the  computation  time  for  subsequent  phases  of  clipping.  These  characteristics 
are  due  to  the  serial  nature  of  the  algorithm.  This  is  in  contrast  to  the  edge  clipping  algorithm 
of  Section  4.2  where  the  clipping  of  an  edge  against  each  boundary  plane  can  be  executed  in 
parallel. 
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Out  of  view 


Visible 


(C) 

FIG.  4.6  POLYGON  CLIPPING 
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5.  HIDDEN  SURFACE  ALGORITHMS 


Application  of  the  preceding  methods  to  three-dimensional  objects  will  produce  two- 
dimensional  perspective  images  with  one  significant  deficiency:  namely  that  object  faces,  which 
are  in  reality  occluded  from  the  viewer  by  other  objects,  appear  in  the  image.  In  practice  the 
removal  of  these  extraneous  faces  from  the  image  is  achieved  by  a  “hidden  surface  algorithm". 
Typically  such  an  algorithm  has  two  underlying  features:  first  the  algorithm  sorts  through  a 
collection  of  edges,  faces  or  objects  according  to  some  criteria  until  the  visible  elements  of  the 
picture  are  determined,  and  secondly,  utility  is  derived  from  the  coherent  nature  of  the  scene 
being  generated.  (The  term  "coherent"  will  be  used  to  describe  the  extent  to  which  the  scene 
being  depicted  is  limited  in  spatial  and  temporal  variability.) 

In  respect  of  the  preceding  remarks,  the  order  and  type  of  sort  used,  and  the  coherence 
properties  exploited  depends  on  the  description  of  the  constituent  objects  and  the  output  medium 
for  the  generated  picture.  Since  consideration  here  is  restricted  to  objects  modelled  as  convex 
polyhedra  and  raster  scan  display  devices,  the  discussion  in  this  section  is  limited  to  hidden 
surface  algorithms  that  fall  into  the  category  commonly  termed  “scan  line  algorithms". 

5.1  Back  Face  Elimination 

A  face  of  an  object,  hidden  by  its  own  volume  from  the  observer  is  termed  a  “back  face”. 
Although  most  of  the  scan  line  algorithms  discussed  in  the  next  section  process  and  eliminate 
back  faces  in  exactly  the  same  way  as  they  do  surfaces  occluded  by  other  objects,  it  may  prove 
more  efficient  to  remove  back  faces  prior  to  polygon  (or  edge)  clipping. 

To  determine  whether  an  object  face  is  or  is  not  a  back  face  with  respect  to  the  observer, 
it  is  necessary  to  compute: 

A  = 

<•'  n' 

where  c  and  n  are  the  face  centroid  and  outward  normal  vector  respectively 
and  it  can  be  concluded-7  that  if 

A  >  0 

then  the  face  is  occluded  from  view  by  its  own  volume.  Since  c  and  n  can  both  be  determined 
from  vertex  data,  the  preceding  computation  can  be  readily  included  in  any  image  synthesis 
procedure. 

5.2  Review  of  Some  Hidden  Surface  Algorithms 

The  purpose  of  this  section  is  to  rev  iew  some  existing  hidden  surface  algorithms  which  have 
real  time  capability,  and  to  determine  the  dominant  requirements  for  an  efficient  algorithm. 
For  a  full  description  of  ten  hidden  surface  algorithms  the  interested  reader  is  referred  to  the 
excellent  article  by  Sutherland  et  al.r‘ 

In  a  broad  sense  hidden  surface  algorithms  can  be  classified  as: 

(a)  Object  Space  Algorithms:  these  utilize  the  observer  frame  (O  X  description  of  the 

scene  to  compute  the  visible  surfaces.  The  computation  is  performed  with  sufficient 
precision  so  that  the  synthesized  image  is  correct  even  if  enlarged  many  times. 

(/>)  Image  Space  Algorithms:  these  perform  the  computation  in  the  image  space  OsXsYs 
and  require  only  sufficient  accuracy  to  match  the  resolution  of  the  display  device. 

(p)  List  Priority  Algorithms:  these  work  partly  in  the  observer  frame  and  partly  in  the 
image  space. 

In  terms  of  performance,  the  execution  time  for  an  object  space  algorithm  increases  as  a 
function  of  the  scene  complexity,  whilst  for  image  space  methods  it  has  an  upper  bound  which 
is  independent  of  scene  complexity  .  The  reason  for  the  latter  property  is  that  the  resolution  limit 
of  the  display  device  provides  a  convenient  culling  criterion  for  object  images,  i.e.  images  smaller 
than  the  resolution  limit  can  be  eliminated  from  further  processing  by  the  hidden  surface 
algorithm.  It  is  for  this  reason  that  algorithms  based  on  image  space  computations  (i.e.  image 
space  and  priority  list  algorithms)  are  the  only  methods  under  consideration  for  real  time 
picture  generation.  Hence  attention  will  be  restricted  to  this  class  of  algorithms. 
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Image  space  algorithms  can  he  convenient!)  classified  according  to  the  order  in  which  the 
image  space  polygons  are  sorted.  The  basic  difference  is  whether  the  depth  sort  is  performed 
before  the  horizontal  and  vertical  sorts  or  sice  versa.  There  is  one  exception  to  this  scheme  and 
that  is  the  area  based  algorithm  of  Warnock. 

/.  H  unlock  Algorithm-1 

The  general  idea  behind  Warnock. 's  algorithm  is  to  sub-divide  the  image  space  picture  into 
portions  (typically  squares)  termed  “sample  windows'  .  Warnock  declares  a  sample  window  to  be 
homogeneous  if:  (i)  no  faces  fall  within  the  sample  window  or  (ji)  one  face  completely  covers 
the  window  and  is  nearer  the  viewpoint  than  every  other  face  that  tails  within  the  window  and 
hence  no  further  processing  is  necessary.  If  a  sample  window  is  not  homogeneous  then  it  is 
divided  into  four  smaller  sample  windows  and  each  of  these  is  examined  analogously.  The  sub¬ 
division  process  terminates  at  the  resolution  limit  of  the  display  device. 

The  Warnock  algorithm  has  two  major  defects:*  first,  the  relationship  between  object  faces 
and  display  screen  area  is  difficult  to  compute,  and  second,  no  suitable  output  device  exists  that 
can  output  information  an  area  at  a  time.  In  fact,  the  apparent  random  way  the  algorithm 
partitions  the  picture  requires  that  the  image  be  displayed  on  a  random-scan  display  device. 

II.  Depth  Sort  I'irst 

The  most  significant  algorithms  belonging  to  this  class  are  due  to  Schunuicker  <■/  til.  and 
Newell  ft  ul.  both  algorithms  compute,  in  object  space,  a  priority  list  of  polygons  which  is 
subsequently  utilized  in  image  space  to  eliminate  hidden  surfaces. 

I  a)  Schumacher's  Algorithm 7 

The  priority  list  of  potentially  visible  polygons  is  established  with  the  aid  of  a  polygon 
clustering  concept,  the  main  features  of  which  are: 

(i)  for  linearly  separable  clusters  the  cluster  priority  depends  on  the  location  of  the  view¬ 
point  relative  to  the  separating  planes; 

(li)  the  face  priority  within  a  cluster  depends  only  on  the  topology  of  the  cluster,  is  inde¬ 
pendent  of  the  viewpoint  and  hence  can  be  computed  a  priori. 

The  calculation  of  the  priority  of  several  clusters  is  demonstrated  by  Fig.  5. !(«).*  If  the 
viewpoint  lies  in  region  C.  then  cluster  .'  will  have  priority  over  clusters  1  and  2  whilst  cluster  2 
will  have  priority  over  cluster  I  by  virtue  of  the  fact  that  for  a  given  viewing  position  in  region  C. 
cluster  2  is  closer  to  this  viewpoint  than  cluster  1 .  Txlendtng  this  process  to  the  other  three  regions 
a  tree  structure  (Fig.  5 . 1(A))  can  be  constructed  which  shows  how  the  relationship  of  the  view¬ 
point  to  the  two  separating  planes  produces  one  of  four  possible  orderings  of  the  three  clusters. 
The  concept  extends  to  an  arbitrary  number  of  linearly  separable  clusters. 

The  computation  of  face  priority  (with  reference  to  Fig.  5.2(r/l)  requires  computing  whether 
face  A  can.  from  any  viewpoint,  hide  face  B.  If  this  is  so  then  face  A  has  priority  over  face  (i. 
Flence  face  priority  within  a  cluster  will  be  independent  of  viewpoint  since  different  back  faces 
are  eliminated  for  each  viewpoint  leaving  the  remaining  faces  ordered  correctly  (see  Fig.  5.2). 

The  generation  of  the  processed  image  is  achieved  in  two  steps.  Firstly,  for  the  given  view¬ 
point  the  back  faces  of  objects  arc  eliminated  and  a  priority  list  of  polygons  is  computed  by 
comparing  the  viewpoint  to  the  separating  planes.  Then  for  each  scan  line  the  edges  intersected 
are  determined  and  utilizing  the  priority  list  of  polygons  the  visible  surface  at  each  pixel  is 
determined 

Although  the  computation  of  the  cluster  priority  list  is  potentially  a  costly  process  (since  it 
may  involve  the  search  of  an  extensive  tree  structure)  the  algorithm  is  able  to  capitalize  on  frame 
coherence;  i.c.  the  cluster  priority  list  remains  unchanged  from  one  frame  to  the  next  unless  the 
viewpoint  crosses  one  of  the  separating  planes. 

The  notion  of  separating  planes  and  list  priority  have  been  utilized  in  Reference  2  (p.  170). 

(h)  Newell's  Algorithm'' 

The  principal  significance  of  Newell's  algorithm  is  the  development  of  the  concept  of 
“over  writing". 
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FIG.  5.2 

The  algorithm  first  sort-,  the  collection  of  faces  into  a  priority  order  according  to  their 
distances  from  the  viewing  plane.  This  information  is  then  utilized  to  establish  the  visibility 
priority  of  polygon  segments  on  a  given  scan  line.  Those  segments  with  a  lesser  priority  are 
written  into  a  scan  line  buffer  before  writing  those  with  a  higher  priority.  Once  the  entire  priority 
list  has  been  processed  the  buffer  will  have  a  correct  hidden  surface  view  since  higher  priority 
faces  have  overwritten  lower  priority  ones.  Whilst  there  is  considerable  overhead  in  writing  into 
buffer  segments  that  may  eventually  be  obscured,  some  high  quality  pictures  have  been  produced 
by  the  algorithm.8 

A  technique  similar  to  Newell's,  but  based  on  a  barrel  memory  of  MOS  shift  registers, 
has  been  proposed  by  Sale  and  Bromley. !l  Although  the  predicted  efficiency  scents  promising 
from  the  point  of  view  of  real  time  image  generation,  the  technique  is  yet  to  be  implemented. 

III.  Depth- Last  Sort 

The  algorithms  using  this  sorting  order  have  been  devised  by  Watkins.8  Bouknight1  and 
Wylie  el  a/.10  and  have  a  close  resemblance  to  each  other.  All  three  procedures  first  sort  the 
visible  edges  in  order  of  their  occurrence  in  llie  >\  direction  (this  is  termed  the  “  K-sort"). 
Then  for  each  scan  line  the  edge  intercepts  are  sorted  in  the  .V,  direction  (  V-sort)  and  finally 
a  Z-depth  search  determines  the  visible  face  at  each  pixel.  The  de>  th  search  is  performed  last 
under  the  premise  that  the  first  two  sorts  w  ill  decrease  the  number  of  depth  comparisons  needed 
to  establish  the  visible  surface. 

Each  of  the  algorithms  utilizes  scan  line  coherence.  That  is.  edges  that  intersect  a  scan  line 
are  likely  to  intersect  the  next  one.  Hence,  as  processing  for  each  scan  line  begins,  the  V-sorted 
list  is  examined  to  find  new  edges  that  begin  on  the  scan  line  and  these  are  then  added  to  the 
ones  already  entered.  Edges  that  lerminalc  on  this  scan  line  are  discarded. 
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The  algorithms  next  examine  the  list  of  "active'’  edges  to  compute  which  faces  are  visible 
in  each  portion  of  the  scan  line.  I  bis  is  accomplished  by  partitioning  the  scan  line  into  smaller 
segments  called  “sample  spans",  the  extent  of  a  span  depends  on  the  particular  algorithm  being 
used.  A  depth  comparison  amongst  all  the  faces  whose  edges  cross  the  span  determines  l he  visible 
content  of  the  span. 

The  depth  comparison  compulation  can  be  made  more  efficient  by  the  observation  made 
in  Ref.  10  concerning  ilc/'lli  coin-wire:  if  the  same  faces  are  intersected  by  one  scan  line  as 
by  the  previous  one,  and  if  the  .V-crossing  order  of  the  edges  are  the  same,  then  the  depth  com¬ 
parison  computation  need  not  be  repeated.  I  he  same  laces  will  be  visible  as  before  although 
their  extent  in  A  may  be  ddVerent. 

5.3  Sorting 

Sorting  is  central  to  the  hidden  surface  problem  and  hence  considerable  care  must  be 
exercised  in  selecting  sorting  methods  which  will  conserve  compulation  time  by  capitalizing  on 
the  coherence  available  in  the  scenes  being  rendered.  Three  sorting  algorithms,  which  have  been 
incorporated  in  a  number  of  hidden  surface  algorithms,  will  be  reviewed,  hor  this  purpose  it 

will  be  assumed  that  records  Ah . A‘\  are  to  be  sorted  in  non-decreasing  order  of  their  keys, 

A. . A.v. 

Quicksort:  This  is  a  comparison  exchange  scheme  ideally  suited  for  serial  computation. 
The  execution  of  the  algorithm  is  as  follows:1-  keep  two  pointers  /  and  /  with  /  =  I  and  j  =  N 
initially.  Compare  A, :  A,  and  if  no  exchange  is  icquired  decrease  /  by  I  and  repeat  the  process. 
After  an  exchange  first  occurs,  increase  i  by  I  and  continue  comparing  A,  A,  and  increasing  i 
until  another  exchange  occurs.  Then  decreasing  /  again,  continue  the  process  until  i  -  j.  As  an 
illustration  of  the  procedure  consider  the  following  example 


Given : 

503 

512 

90S 

S97 

426 

154 

509 

677 

Decrease  j 

1st  Exchange: 

154 

512 

90S 

S9~ 

27> 

426 

503 

509 

677 

Increase  ; 

2nd  Exchange: 

154 

50.1 

90S 

S97 

2~n 

426 

512 

509 

677 

Decrease  j 

3rd  Exchange: 

154 

426 

90S 

S9n 

2  “5 

503 

512 

509 

677 

Increase  i 

4th  Exchange: 

154 

426 

503 

S97 

275 

vox 

512 

509 

677 

Decrease  j 

5th  Exchange: 

154 

426 

2' 5 

S97 

501 

90S 

512 

509 

677 

Increase  i 

6th  Exchange: 

154 

426 

275 

503 

90S 

512 

509 

677 

(A',  and  A’;  are  shown  in  heavy  italic  type.) 

Observe  that  by  the  time  /  =  /  the  original  record  R\  will  have  moved  into  its  correct  place 
and  that  there  will  be  no  greater  keys  to  its  left,  nor  smaller  keys  to  its  right.  Hence  the  resulting 
list  can  be  partitioned  into  two  simpler  sorting  problems.  Furthermore  eacn  comparison  will 
involve  the  original  key  Ai.  which  may  be  kept  in  a  register  and  need  not  be  stored  until  the 
end  of  the  computation.  The  computation  time1-  associated  with  a  Quicksort  is  of  the  order  of 
N  logs  V  for  a  random  list  and  of  the  order  of  .V-  for  a  list  nearly  in  sort.  Unlike  most  sorting 
methods  a  Quicksort  is  more  efficient  for  a  disordered  list. 

Radix  sort:  This  is  a  procedure  based  on  the  digits  of  the  key  s  and  requires  2  .V  memory 
locations  for  processing  V  records.  The  sort  is  carried  out  as  follows:1-  start  with  a  distribution 
sort  based  on  the  least  significant  digit  of  the  keys  (in  radix  M )  and  partition  the  last  ,Y  memory 
locations  (termed  auxiliary  store)  into  \l  segments:  each  segment  corresponding  to  one  of  the 
M  digits  and  the  number  of  memory  locations  in  each  segment  being  determined  by  the  distri¬ 
bution  sort.  I  nch  record  is  then  placed,  according  to  its  least  significant  digit,  in  the  appropriate 
segment  in  the  auxiliarv  store.  Earning  out  another  distribution  sort  on  the  next  least  significant 
digit,  move  the  records  back  into  the  original  input  area,  repeating  the  procedure  until  the  most 
significant  digit. 


As  an  illustration  consider  the  preceding  example: 


Input  area:  503  512 

908 

897 

275 

426 

154 

509 

677 

703 

Counts  for  units  digit  distribution 

0 

0  1 

s 

1  1 

1 

2  1 

1 

Storage  allocation  based  on  distribution: 

0 

0  1 

3 

4  5 

6 

8  9 

10 

Auxiliary  area:  512  503 

703 

154 

275 

426 

897 

677 

708 

509 

Distribution  for  tens  digit: 

4 

1  1 

0 

0  1 

0 

2  0 

1 

Storage  allocation: 

4 

5  6 

6 

6  7 

7 

9  9 

10 

Input  area:  503  703 

908 

509 

512 

426 

154 

275 

677 

897 

Distribution  for  hundreds  digit: 

0 

I  1 

0 

1  3 

1 

1  1 

1 

Storage  allocation : 

0 

1  2 

2 

3  6 

7 

8  9 

10 

Auxiliary  area:  154  275 

426 

503 

509 

512 

677 

703 

897 

908 

Observe  that  the  number  of  ] 

passes  required 

to  sort 

a  list 

depends 

on  the  radix  and 

the 

number  digits  in  the  keys  but  is  independent  of  A'.  Moreover  it  can  be  shown  that  for  random 
data  the  sorting  time  is  of  the  order  of  N. 

In  terms  of  the  implementation  (memory  requirement,  hardware)  both  the  Quicksort 
and  the  radix  sort  are  most  efficient  for  large  V  and  random  data.  In  the  context  of  scan  line 
algorithms,  these  techniques  have  been  utilized  in  performing  the  Y  sort  for  whici.  they  are 
ideally  suited.  The  reason  for  this  is  that  the  finite  display  resolution  coupled  with  edge  clipping 
implies  that  a  radix  sort  need  only  consider  nine  or  ten  bits  of  a  16-bit  key  field.  This  is  not  the 
case  for  the  Z  sort  since  the  distribution  of  depths  in  any  image  will,  in  general,  be  unknown. 
This  fact  is  part  of  the  reason  for  the  attraction  of  depth-sort  last  scan  line  algorithm. 

Bubble  sort:  This  is  perhaps  the  most  obvious  way  to  sort  by  comparison  and  exchange. 
The  process  is  as  follows:  compare  Aj  and  A'L>.  interchange  R\.  R<  if  keys  are  out  of  order: 
repeat  for  R<  and  R.i.  R.t  and  R\.  etc.  During  the  first  pass  of  this  process  the  record  with  the 
largest  key  will  move  to  become  R.\.  Repeated  passes  will  move  appropriate  records  into  positions 
Ry  i.  Ry  ■>.  etc.,  until  the  entire  list  is  in  soi  l.  The  time  required  to  sort  random  data  is  of  the 
order  of  N-  making  it  unsuitable  for  large  A'.  Nevertheless  it  is  well  suited  to  performing  the 
X  sort  from  one  scan  line  to  the  next.1  The  reason  being  that  line  to  line  coherence  implies  that 
edge  order  changes  infrequently  and  when  it  does  it  normally  only  involves  adjacent  pairs  whose 
order  need  only  be  interchanged  to  restore  the  correct  ordering.  Thus  not  only  is  the  “bubbling" 
operation  required  infrequently,  but  the  “bubble"  does  not  have  to  move  very  far  in  the  list. 


6.  IMAGE  QUALITY 

In  scope,  image  quality  encompasses  those  attributes  of  detail  without  which  significant 
differentiation  could  be  made  between  the  physical  and  synthesized  scene  irrespective  of  image 
content.  In  this  sense  the  parameters  of  interest  for  CGI  flight  simulation  visuals  arc  shading, 
fading,  shadows  and  quantization  effects. 

6.1  Shading  Functions 

The  essence  of  shading  computer  synthesized  images  is  the  computation,  via  a  shading 
function,  of  the  intensity  and  colour  of  each  visible  point  of  an  object  from  the  characteristics 
of  the  light  source,  the  nature  of  the  object  and  the  position  of  the  observer,  fn  addition,  proper 
shading  depends  on  a  further  number  of  objective  factors,  of  which  the  following  are  significant 
but  by  no  means  exhaustive: 

(а)  difTuse  and  specular  reflections: 

(б)  multiple  light  sources  including  inter-surface  reflections; 

(r)  haziness  (or  blurring)  as  a  function  of  distance: 

(d)  shadows. 

A  number  of  shading  functions  have  been  proposed  that  accommodate  some  of  the  above 
features.  Although  only  one  of  them  refers  .specifically  to  flight  simulation  visuals  it  is  instructive 
to  review  these  approaches. 


Romney22  assumes  that  a  point  light  source  is  located  at  the  observer's  eye  and  employs 
the  empirically  derived  shading  rule: 


cos2  II 


(6.1.1) 


where  0  is  the  angle  of  view  measured  from  the  surface  normal; 
r  is  the  distance  between  the  observer  and  the  source 

to  render  shaded  images  of  dilTuse  surfaced  objects  for  a  monochrome  raster  display  The 
resulting  pictures  have  certain  desirable  features,  namely  that  for  r  fixed,  surfaces  pointing  away 
from  the  observer  appear  less  bright  than  those  facing  the  observer.  In  contrast,  for  I)  fixed, 
the  term  I  > 1  drops  off  quite  rapidly  for  small  r  and  changes  move  slowly  for  large  r.  The  effect 
is  to  render  closer  objects  bright  and  the  more  distant  objects  with  a  less  bright  but  nearly 
identical  shade.  Although  the  l/H  term  leads  to  a  “miner's  lamp"  effect,  (6.1.1)  could  be  useful 
as  a  first  approximation  to  a  more  realistic  shading  function,  in  the  generation  of  night  scenes 
comprised  of  diffuse  surfaces  illuminated  by  directional  point  light  sources. 

In  the  case  of  day  scenes  illuminated  by  the  sun  and  the  sky  (6.1.1)  is  not  applicable. 
Instead  each  object  surface  is  characterized  by  a  predetermined  shade  about  which  the  assigned 
shade  varies  according  to  the  relative  orientation  of  the  surface  with  respect  to  the  sun. 

A  relatively  simple  implementation  of  this  has  been  reported  in  Reference  2.  It  involves 
computing  the  angular  position  of  the  sun  with  respect  to  each  surface  normal  and  the  cosine 
of  the  angle  is  used  to  modify  60"„  of  the  pre-assigned  shade  whilst  the  remaining  40",,  is  assumed 
due  to  dilTuse  illumination  from  the  sky  and  reflections  from  other  surfaces. 

For  the  inclusion  of  specular  reflections  under  point  source  illumination,  Warnock21  and 
Phong13  have  suggested  the  addition  of  a  tern  jf  the  form: 

IF(</>)[cos  (H 

,,  (6.1.2) 
ih 


( where  0  is  angle  between  the  line  of  sight  and  the  surface  normal  (in  the  sense  of  Fig.  6.1),  <t>  is 
the  angle  of  incidence; 

H(  )  is  a  function  of  the  ratio  of  reflected  and  incident  light  at  angle  of  incidence  4>: 
cl  is  the  distance  between  the  observer  and  the  object  surface). 


Observer 
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to  a  shading  function  such  as  (6.1.1).  The  function  MT  )  and  m  are  chosen  empirically,  although 
in  general  a  large  value  of  tn  is  required  to  characterize  a  glossy  surface.  This  follows  from  the 
fact  that  the  greatest  amount  of  specular  reflection  occurs  in  the  region  0  —  and  hence  the 
inclusion  of  [cos  (0  0)]"'  which  falls  oir  rapidly  outside  the  region. 

6.2  Horizon  Fading 

Although  the  approach  to  shading  embodied  in  (6.1.1)  and  (6.1.2)  lakes  into  account  the 
nature  of  the  surfaces,  the  position  of  the  source  and  the  observer,  no  allowance  is  made  for 
the  observed  atmospheric  effect  of  the  fading  of  colours  to  a  uniform  fog-grey  at  the  horizon. 
The  result  is  that  the  generated  image  has  a  “cartoon-like"  quality  which  in  terms  of  flight 
simulation  reduces  depth  perception." 

As  reported  in  Reference  2  the  remedy  for  this  deficiency  is  to  desaturate  the  colours  of  all 
objects  in  the  scene  as  an  exponential  function  of  distance  to  the  observer.  An  example"  of 
such  a  computation  is: 

Cf  =  FC  4-  (l  -  F)G 

where  Cf  =  the  resultant  shade; 

F  =  range  factor,  e  ktl,  in  which  k  —  attenuation  coefficient,  which  may  depend  on  the 
altitude  and  elevation  angle  (with  respect  to  observer),  and  d  =  range  of  object 
from  observer; 

C  =  assigned  shade  of  object  (as  determined  by  the  appropriate  shading  function); 

G  =  fog/haze  colour. 

6.3  Shading  of  Curved  Surfaces 

It  has  been  implicit  in  the  preceding  discussion  that  the  objects  had  planar  polygonal  faces. 
For  this  class  of  objects  it  has  been  demonstrated"  that  a  shading  rule  which  embodies  terms  of 
the  form  of  (6.1.1)  and  (6.1.2)  together  with  a  fading  function  will  produce  realistic  pictures. 
The  centroid,  normal  and  intrinsic  colour  (spectral  reflectance)  of  each  face  constitute  the 
required  information  for  the  computations. 

The  application  of  the  above  approach  to  curved  surfaces  approximated  by  planar  polygons 
will  result  in  a  shade  discontinuity  at  polygon  boundaries  destroying  the  smoothness  of  the 
surface.  One  might  expect  that  the  problem  would  be  alleviated  by  reducing  the  size  of  the 
approximating  polygons.  Unfortunately,  because  of  visual  perception  effects,  the  reduction  of 
polygon  size  is  not  as  beneficial  as  might  be  expected.13  The  principal  phenomenon  responsible 
for  this  is  the  Mach  Band  Effect  which  states  that  intensity  distortion  results  from  discontinuity 
in  the  first  derivative  of  the  shading  function. 


To  restore  the  smooth  appearance  of  curved  surfaces  approximated  by  polygons,  Gouraud15 
observed  that  '.he  value  of  the  shading  function  as  well  as  its  derivative  has  to  be  continuous 
across  polygon  boundaries.  Gouraud  developed  a  simple  technique,  based  on  shading  values  at 
polygon  vertices  and  interpolation,  to  restore  smoothness.  To  illustrate  the  method  consider  the 
computation  of  the  shade  at  point  Q  in  Fig.  6.2.  Firstly  the  shade  at  vertices  A,  B,  C'  is  computed, 
with  the  normal  at  each  vertex  being  taken  as  the  average  of  the  normals  of  the  adjoining  faces. 
Then  linear  interpolation  between  the  shade  at  A  and  B.  and  A  and  (’  will  give  the  shade  at 
points  P  and  R  respectively.  A  second  interpolation  between  P  and  R  gives  the  desired  value  at  Q. 

The  Gouraud  shading  technique  has  been  implemented  in  real  time-  and  static17  generation 
of  a  variety  of  images  of  great  realism.  In  the  context  of  scan  line  algorithms,  the  technique  will 
require  that  each  vertex  be  linked  to  its  surrounding  faces  in  order  to  compute  the  vertex 
normals.  In  general  this  additional  computation  will  deteriorate  the  real  time  performance  of  a 
hidden  surface  algorithm  with  the  result  that  the  number  of  curved  objects  (e.g.  aircraft  fuselages) 
present  in  a  scene  will  be  limited. 

A  useful  modification  of  the  preceding  approach  is  applicable  to  the  shading  of  long  objects 
(such  as  runways)  for  which  the  face  centroid  is  an  inadequate  measure  of  depth.  Specifically 
the  shade  calculation  at  each  vertex  is  based  on  the  surface  normal  and  the  vertex  depth  such 
that  the  shade  at  any  interior  point  is  again  determined  by  two  linear  interpolations. 


6.4  Representation  of  the  Sky 


For  a  scene  observed  near  the  surface  of  the  earth  the  horizon  can  be  represented  as  a 
circle  of  radius 


r/,  =  \  2//v:  I  r,  small 


where  r ,  is  the  radius  of  the  earth  and  /  is  the  altitude  of  the  observer,  as  illustrated  in 
Fig.  6.3(a).  The  image  of  the  visible  portion  of  the  horizon  is  a  straight  line  which  forms  one 
of  the  edges  of  the  polygon  representing  the  sky  (Fig.  6.3(6)).  In  the  scan  line  algorithm 
sense  this  polygon  is  assigned  the  lowest  priority  and  hence  occludes  no  other  object  from  the 
observer. 

A  realistic  representation  of  the  sky  requires  that  the  colour  of  the  sky  desaturate  in  the 
vicinity  of  the  horizon.  (The  region  is  specified  by  A  in  Fig.  6. Mu)  and  its  value  has  to  be  deter¬ 
mined  empirically.)  One  way  of  rendering  this  desaturation  is  to  use  Gouraud's  shading  tech¬ 
nique  (Section  6.3).  To  illustrate  consider  the  situation  depicted  in  Fig.  6.3(f)  and  assume  the 
colour  of  the  sky  is  B  whilst  the  desired  grey  shade  at  the  horizon  is  G.  Assign  the  colour  B 
to  vertices  az.b>,h^c\  and  colour  G  to  vertices  ci).h\.  whilst  the  colour  at  a>  is  determined 
by  interpolation  between  tfi  and  az-  The  polygon  (<q.  u-i,  c\.  A*.  Ai)  is  shaded  by  Gouraud's 
method  whilst  the  polygon  (Aj.  A3,  o)  is  coloured  uniformly  B.  Other  images  involving  the  sky 
can  be  handled  analogously. 


6.5  Shadows 

There  are  two  types  of  shadows  that  result  from  point  source  illumination  of  a  scene: 

(i)  A  projected  shadow  area  is  a  visible  surface  or  portion  of  a  visible  surface  from  every 
point  of  which  a  vector  to  the  point  light  source  intersects  a  solid  object  (area  A. 
Fig.  6.4); 

(ii)  A  self-shadow  face  >s  a  visible  scene  face  which  is  orientated  away  from  the  point  light 
source  (face  fl.  Fig.  6.4). 

In  a  day  scene  the  presence  of  a  diffuse  source  (the  sky)  results  in  object  edges  being  visible 
within  shadows.  Moreover  the  perceived  colour  of  an  area  in  shadow  is  increased  in  saturation 
but  reduced  in  brightness. 

Although  shadows  are  desirable  from  the  point  of  view  of  realism,  perception,  and  simulation 
of  time  of  day,  they  have  received  minimal  attention.  This  is  due  in  most  part  to  the  additional 
computational  effort  required  to  determine  shadow  areas.  The  computational  problem  is  accentu¬ 
ated  by  the  fact  that  a  shadow  of  one  object  may  interact  with  another  object  and  its  shadow  as 
illustrated  in  Fig.  6.5.  Hence  in  addition  to  depth  relationships  amongst  scene  objects  one  needs 
to  have  a  knowledge  of  the  relative  orientation  of  objects  amongst  themselves  and  with  respect 
to  the  light  source  for  shadow  generation. 


6.6  Quantization  Effects 


These  effects  arise  from  the  discrete  nature  of  a  raster  scan  display,  and  in  the  case  of 
dynamic  pictures,  are  responsible  for  distraction,  loss  of  realism  and  false  motional  cues.  1  he 
particular  quantization  effect  present  in  a  picture  will  depend  on  the  particular  rule  employed 
to  decide  whether  a  pixel  is  within  a  surface  or  not.  Typically  if  the  centre  of  a  pixel  falls  within 
a  surface  then  the  whole  pixel  is  assigned  the  shade  of  that  surface. 

The  resulting  quantization  effects  can  he  categorized  as  follows: 

(i)  Step  Effect.'1  Edges  that  are  straight  appear  discontinuous.  This  is  particularly  apparent 
on  near  vertical  and  near  horizontal  edges  separating  faces  of  significantly  different 
shade  (Fig.  6.6(r/)). 

(ii)  Face  Crawling.  Consider  a  face  21  elements  wide  with  vertical  edges.  As  the  face  moves 
across  the  screen  the  face  width  will  alternate  between  two  and  three  elements  causing 
the  face  to  appear  to  move  by  advancing  to  the  right  then  receding  from  the  left. 

(iii)  Face  break-up.  Consider  a  near  horizontal  face  one  scan  line  in  width.  As  it  intersects 
a  given  scan  line,  there  will  be  groups  of  elements  whose  centres  fall  within  the  face — 
these  will  receive  full  colour.  Flowever  on  the  next  scan  line  the  elements  with  centres 
within  the  face  will  be  laterally  displaced  causing  the  face  to  appear  to  be  made  up  of 
discrete  segments  (Fig.  6.6(b)). 

(iv)  Blinking.  A  face  of  less  than  one  element  width  in  its  smallest  dimension  may  be  so 
orientated  that  it  will  periodically  contain  no  element  centre,  in  which  case  it  will 
disappear. 
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FIG.  6.6  QUANTIZATION  EFFECTS 

An  effective  solution  to  these  problems-  is  to  display  each  pixel  which  is  cut  by  an  edge  as 
a  blend  of  the  colours  within  it,  the  percentage  of  each  is  determined  in  accordance  with  the 
area  involved.  One  way  to  mechanize23  this  is  to  sub-divide  each  scan  tine  into  k  sub-lines  and 


each  element  into  A  suh-clemcntv  1  hen  the  assigned  colour  of  a  pixel  is  the  average  of  the  A  - 
sub-pixels.  If  more  than  two  edges  cross  a  given  pixel  then  only  the  two  edges  associated  with 
the  two  closest  surfaces  need  to  he  considered  in  the  smoothing  operation 

That  the  above  procedures  provide  an  adequate  rented)  to  the  effects  of  quantization  are 
evidenced  by  the  synthesized  images  reported  in  Kefs  2  and  2 t  A  comprehensive  review  of  the 
“state  of  the  art"  in  the  elimination  of  quantization  effects  can  he  found  in  Reference  24. 

6.7  Night  Scenes 

I  he  “world"  of  a  night  scene  simulation  typically  consists  of  lights.-'"  gross  terrain  and 
cultural  features  with  low  detail  and  low  contrast,  and  rather  concentrated  aieas  at  airports 
where  faithful  rendition  of  detail  is  important  C  ommercial  (Til  systems  dedicated  to  night 
visuals  have  employed  high  resolution  beam  penetration  (  R  I  displays.  resulting  in  high  quality 
images,  whilst  until  recently.  raster  scan  based  night  scenes  have  been  only  moderated)  successful 
due  to  resolution  limitations Ih.it  is,  if  a  single  pixel  represents  a  point  light  source,  the  motion 
of  the  source  will  result  in  objectionable  discrete  motion  on  the  display  which  is  accentuated  by 
the  high  contrast  between  background  and  lights. 

The  general  approach,  which  is  akin  to  that  of  the  previous  section,  to  overcome  this 
problem  is  to  spread  each  light  source  over  adtaccnt  pixels  smoothing  the  motion  of  light  sources. 
Nevertheless  the  number  of  pixels  over  which  a  light  source  is  spread  has  to  he  chosen  carefully 
since  the  effective  size  of  the  light  source  image  will  increase. 

7.  (  ONCT.t  dim;  rtmarkn 

The  topics  discussed  in  the  preceding  section  represent  a  broad  spectrum  of  techniques  for 
real  time  computer  synthesis  of  images.  However  it  capability  and  effectiveness  is  to  be  enhanced 
then  a  number  of  areas  and  possible  alternatives  need  to  be  investigated  These  delineate  into 
environment  modelling,  hidden  surface  algorithms  and  image  quality 

Environment  Modelling.  I  he  modelling  of  ohiccts  by  polyhedra  is  a  convenient  way  of 
numerically  characterizing  the  visual  environment  I  conomy  insists  that  the  number  of  polygons 
be  minimized,  while  quality  of  representation  insists  that  the  approximation  render  the  image 
faithfully.  Tor  efficient  environment  modelling,  quantitative  guidelines,  accommodating  these 
two  criteria,  have  to  be  found  for  choosing  the  approximating  polygons.  Moreover,  it  may 
prove  convenient  in  certain  situations  to  model  curved  surfaces  by  quadratic  or  higher  degree 
surface  patches.  As  evidenced  by  published  results  (Refs  16  and  25)  pictures  of  remarkable 
quality  can  be  produced  by  the  method  although  the  real  time  computational  load  is  at  present 
a  limiting  factor. 

Hidden  Surface  Algorithms.  The  outstanding  feature  of  the  algorithms  discussed  is  the  use 
of  coherency  as  a  basis  for  efficiently  computing  the  image.  I  or  example  Schumacker  makes  use 
of  cluster  coherence  to  reduce  the  per  frame  computing  cost  (at  the  expense  of  additional 
environment  preparation).  On  the  other  hand  the  scan  line  algorithms  make  use  of  lateral 
coherency  to  reduce  the  number  of  surfaces  under  consideration  at  any  one  point  on  the  display. 
The  latter  is  useful  in  that  the  number  of  depth  comparisons  necessary  are  small  which  is  in 
contrast  to  the  object  space  algorithms  which  depth  sort  the  image  polygons  first. 

The  merging  of  ideas  from  object  and  image  space  methods  may  yield  more  efficient  versions 
of  a  number  of  the  algorithms  discussed  in  Section  5.2.  Tor  example: 

(i)  Newell's  algorithm  might  make  use  of  frame  to  frame  coherence  by  saving  the  priority 
order  from  one  frame  to  the  next ; 

(ii)  Bouknight's  and  Watkins'  algorithms  might  make  use  of  Schumacker  s  clustering 
concept  to  reduce  the  final  depth  comparison  computation 

Image  Quality.  Whilst  shading  anil  edge  smoothing  are  the  most  significant  aspects  of 
picture  quality  there  are  other  areas,  relevant  to  image  recognition  and  cues.1  ’  that  warrant 
further  investigation.  In  particular,  for  low  level  attack  and  nap  of  the  earth  flight  simulation, 
texture,  reflections  and  shadows,  are  requisites  for  the  accurate  and  detailed  rendition  of  man¬ 
made  and  natural  features,  including  buildings,  contoured  terrain  and  gradation  of  surfaces.2* 
Part  of  the  problem  with  synthesizing  these  features  is  that  they  are  difficult,  as  in  the  case  of 
texture,  to  characterize  numerically. 
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